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ASSESSING THE IMPACT OF PEACE BUILDING PROCESSES 

DR. PAUL R. KIMMEL 



INTRODUCTION 

There has been a nev emphasis in the approach of social scientists to the study of international 
peace. A fev quotes vill iilustrate some common themes that led to this changed emphasis. Dr. 
Serge King: "If you put your focus on things the vay you vould like them to be, or on the good 
aspects of those things you don't particularly like, that's vhat you strengthen and in a sense, 
legitimize; on the contrary, if you keep putting your attention on and resisting vhat you don't 
like, you veaken yourself and strengthen it, because energy flovs vhere attention goes. Thus, 
the more you hate var and those vho execute var, the more strength and energy you endov'it 
vith, and the more you veaken yourself and make yourself less effective to chaAge things. " 

Dr. David Edvards: "most social theories ... tend to be theories of conflict and violence rather 
than of their reduction. ... even vhen social theories are developed by theorists vho consider 
their vork 'peace research' and are explicitly committed to creating a more peaceful vorld, if 
[their] theories are theories of var, arms racing, conflict escalation, intergroup hostility, or oier 
socially deleterious phenomena ...[they] legitimate the behavior to vhich causal efficacy is being 
attributed ... and disenqwver the audience ..." 

Dr. Paul Kimmel: "most Western social scientists follov the logical-empiricist approach vhich 
assumes that their concepts and techniques vill eventually produce a 'true' understanding of the 
phenomena that they are studying. This 'normal science ^roach' limits their observations, 
analyses, and conclusions to those that are acceptable in their subculture and their larger national 
cultures. There is much to recommend the normal science approach vithin a given culture, 
especially vhen that culture includes many of the values undergirding this approach, but the 
belief that such an ^proach vill arrive at "truths' and its corrollary that these 'truths' vill be 
universal, has negative inqihcations for international and intercultural studies." 

INTERNATIONAL NEGOTIATION 

In a p^er presented the 1990 APA meetings in Boston, I encouraged members of the nevly 
formed Division of Peace Psychology to devote their energies to proxtive peace efforts rather 
than reactive anti-var activities. I suggested that these psychologist study the international 
processes of building relationships and social structures that promote problem-solving for the 
mutual benefit and security of all vhen situations of conflict arise. International negotiations 
(defined as "the deliberate interaction of tvo or more complex social units attempting to define 
the terms of their interdependence") are primary examples of such processes. In my ovn study 
of international negotiation at the U. S. Institute of Peace (USIP), I found that negotiators vho 
understand their ovn subjective cultures and are villing to learn about the subjective cultures of 
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those vith vhom they are negotiating, are more likely to reduce misunderstandings and to 
facilitate the search for mutually acceptable solutions in international meetings. The relationships 
they form vhile collaborating on international problems may in turn ameliorate or avert other 
conflicts based on mi^.understandings and promote international agreements that lead to trust 
among the negotiators and eventually among their nations. 

Tvo obstacles that have hampered our efforts to understand and contribute to such international 
negotiations and the less violent vorld that they can engender are an insistance on the normal 
science approach and a search for universal in human behavior across cultures. A great deal has 
been vritten about the limitations of positivistic ^roaches to the study of human behavior (see 
Lincoln & Cuba, 1985, and Cuba & Lincohi, 1989). To create the nev vays of thinking that are 
needed in our nuclear vorld, ve social scientists must be villing to explore ^proaches and 
methodologies other than those of normal science (such as those of constructivist inquiry and 
fourth generation evaluation) in both our research and education efforts. To assist people in 
situations of conflict to behave productively, ve must help them see that there are a multitude of 
vays of thinking, feeling, reasoning and communicating vith each other. Ve can best help others 
realize their ovn potential and value the contributions of others as ve become more avare of our 
ovn blinders and the limitations of our cultural perspectives and ideologies. 

A TRAINING PROGRAM FOR NEGOTIATORS 

I believe that the most valuable lessons that ve can inq)art through our research, training and 
assessment efforts x^e the notions of learned cultural differences aod the value of cultural self- 
avareness. The notion that everyone potentially has something to offer in the management of 
conflicts and that no p\">sition or ^proach is absolutely best is crucial to peace building. In the 
monograph that I am vri,ting about my USIP study, I have detailed the stages of cultural self- 
avareness in the individW and a tuning program to assist international negotiators in 
developing their ovn avareii^ss and understanding of cultural differences. This morning, I 
vould like to discuss hov I voi^^assess the impact of such training on the individual negotiators, 
on the negotiations in vhich they\^e later involved, and on the broader processes of building 
relationships and social structures tlfej promote problem-solving for mutual benefit and security 
(peace building). These assa<:sments vtsuld not analytically isolate and msasure abstract traits or 
processes (such as empathy, riesibility oV.. moral reasoning) as a normal science approxh might, 
but in keeping vith the nev emphasis on si^earch and equation that I have suggested, would 
look idiographically at specific contejfts in vUch specific individual behaviors make a difference. 

The training of international negotiators that I have proposed involves simulations of specific 
negotiations in vhich they have been involved. Thrae simulations vould be tailored to each 
trainee, vith the significant difference from the xtual negotation being the other negotiator. In 
tlie training program, this negotiator vould be an actor trained to present perceptions, behaviors 
and communications that contrast culturally vith those of che trainee. After the simulations, the 
trainees vould be guided through a discussion of tbeir ejqjeriences vith an emphasis on their 
moti^i^tions and those of the xtor (percei^/ed). The <:i;tor vould then return for a similar 
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discussion and an interviev by the trainee. Finally, the trainees vould examine the values and 
assumptions underlying their behavior and perceptions and those of the xtor. The trainees are 
not told about the training or purpose of the xtor. 

ASSESSMENT OF THE TRAINING PROGRAM 

To assess the impact of this training on the individual international negotiators, I vould observe 
the behavior, perceptions and communication of the trainee in subsequent simulations or 
negotiations. This vould be done in three different contexts. First, the trainee vould be asked to 
comment on an edited video of the original simulation. She or he vould describe the intent or 
meaning of several of the behaviors and communications of the actor. Some of these vould be 
repeats of behaviors discussed in the debriefing of the simulation, others vould be different. A 
measure of the impact of the simulation and debriefing vould be the change in isomorphism of 
the trainee's assessments and the actor's actual intentions (vhat ve vill call accuracy). 

Second, the trainee vould be asked to take part in other simulations of different negotiations vith 
the same and/or different actors. The inqjact of the first simulation and its debriefing vould be 
assessed during the subsequent simulations by observing the extent to vhich the trainee can more 
accurately communicate to the actor his or her intentions and feelings and understand the 
intentions and feelings of the actor. A third measure of impaci vould be the accuracy of the 
trainee's assessments of the actor's intentions and perceptions in the debriefings of the subsequent 
negotiations and in the analyses of the edited videos of these simulations. The assunq)tion, of 
course, is that after taking part in one simulation and debriefing, the trainee's analytic and 
communications skills vill improve (as seen from the perspective of the actor). 

ASSESSMENT OF SUBSEOUENT NEGOTIATTOMS 

This training program vould be an easy environment in vhich to assess the impact of attempts to 
improve mtematio^al negotiation skills. Here ve have more control of the scenerio and videos of 
the negotiation processes. The real vorld of negotiation is much more complex and much less 
accessible to observation and videotaping. In such situations, the assessment strategies of 
constructivist inquiry and fourth generation evaluation are especially relevant. The emphasis in 
this descnptive, ethnographic approxh is on reconstructing an event from the vievpoints of tiiose 
involved. This "naturaUstic" approach to assessment is designed to develop context and time 
bound descnptions and vorking hypotiieses that are joint or collaborative reconstructions of all 
the parties mvolved m tlie inquiry. There is no search for generalizations tM are context, time 
or value free as there is in tiie positivist paradigm of normal science. The evaluators state in 
advance their value orientations and interact vith the individuals being evaluated to systematically 
and empirically reconstruct Uie impact of a program. The evaluator is a reflective actor in the 
reflexive social reality of the assessment process. 

In training programs such as mine, tiie designer of the program should also be involved in the 
assessment process. The reason for this is apparent in the tiiree assessments described above. 
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since these assessments are a part of the training itself. When the assessment is of a real vorld 
negotiation involving one or more of the trainees, the reasoning is less obvious. Indeed, the 
conventional visdom of the normal science ^proach indicates that the evaluation should not be 
undertaken by tliose involved in the training, but by an "independent" third party so there is "no 
bias" in the assessment. 

The constructivist paradigm argues, hovever, that there are no neutral, unbiased or independent 
third parties. Social reality is fundamentally indeterminate and all social scientists vill bring 
their social constructs and values to bear on vhatever they assess. (What often passes for 
neutrality or impartiality is usually a position that is in keeping vith the social status quo. ) If one 
accepts the constructivist paradigm, it becomes ^parent tlat the more sophisticated and informed 
the evaluators are about the programs they are assessing, the more likely they are to promote an 
isomorphic reconstruction of the social impact of that program in their evaluation. In addition, 
the designer of a training program like mine - vhich stresses self-avareness and insight into the 
cultural values and assun:q)tions that underlie trainees' behaviors, feelings and perceptions - must 
be sensitive to his ovn values and assumptions and capable of explicating them to those he is 
training and evaluating. Therefore, I believe that a good case can be made for including myself 
in all of the assessments of the impact of this training program, as long as I follov the systematic 
and replicable procedures of fourth generation evaluation. ^ The social role of assessor vill 
contribute to my vork as program developer in that I vill be regularly receiving feedback about 
the program from those most affected by it. 

At the level of real vorld negotiations, this feedback vill come primarily from intervievs and 
discussions vith the international negotiators involved in the these negotiations. To ascertain 
vhether they have become more collaborative, developed trust and respect for each other, found 
common ground on vhich more of their beliefs, values and assunaitions are negotiable, and are 
perceived by other negotiators as understanding and gracious (outcomes and processes that vould 
be expected from the training) vill require both individual and group conversations. These 
conversations vould occur at several points before, during and after the negotiations to 
reconstruct not only any changes, but also the specific behaviors and communications associated 
vith them. 

In addition to assessing the impact of the previous training program on the negotiators and 
providing information that vould improve the development of future training programs, this 
constructivist inquiry vould also empover the negotiators in the real vorld negotiation and affect 
their behaviors and communications in their meetings. As Lincoln and Cuba point out, fourth 
generation evaluation is a teaching/learning process in vhich all stakeholders including the 



' The fourth generation evaluator must "act not only as the techmcian who facilitates the process but as an active 
participant who shapes the product as veil ... in fourth generation evaluation, the evaluator is a key figure in a 
process that creates a new and more sophisticated "reality' that has built into it direct and immediate implications 
for action (Cuba & Lincoln, 1 989, p. 262)." 
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evaiuator(s) teach am learn from each other. Since the primary goal of my training program is 
helping the negotiators to learn hov to learn during their future negotiations, fourSi generation 
evaluation is entirely compatible vith my training and, irjdeed, can be seen as an integi'al aspect of 
it 

ASSESSMENT OF PEACE BUILDING 

In evaluating the impact of these real vorld negotiations (vhich involve individuals trained 
and/or assessed by me) on the broader processes of building relationships and social structures 
that promote problem-solving for mutual benefit and security (vhal I have called peace building), 
I am interested in tvo different levels of reconstruction: the near term outcomes of the 
negotiations themselves and the longer range implications of these outcomes and of the behaviors 
of the negotiators for their countries and the vorld. In looking at the outcomes, I am interested 
both in the "solutions" the negotiators create to the problems facing them and in any changes that 
occur in their relationships vith each other and vith their constituents. In my monogr^h, I 
suggest that culturally sensitive and skilled negotiators can create hybrid solutions that could not 
have been created by ♦he individuals acting independently or vithout increased cultural 
sensitivity. To test these vorking hypotheses, I vould look at the solutions generated in 
negotiations involving the trained negotiators and compare these vith the solutions to similar 
(current or past) problems arrived at by non-trained negotiators. The criteria for evaluating the 
effectiveness of the different solutions vould be a pragmatic one: vhich of the solutions are 
accepted by the countries involved and vhich of these in turn are most successful in managing 
conflicts and precluding violence? 

The implications of the training and negotiations for the countries of the negotiators vould be 
assessed by looking at hov officials and the public responded to and implemented the solutions 
proposed by their negotiators. While imnn?diate reactions of the goverranent, the media and the 
public are important and therefore vould be measured by standard survey research techniques, I 
am more interested in the longer term implications of the negotiated outcomes and of tlie 
relationships formed by the negotiators. To vhat extent do these contribute to peace building? 

Peace building takes place through social organizations and relationships that can deal vith the 
conflicts, stresses and frustrations that are inevitable in international relations vithout resorting- to 
violent behavior and var. Fourth generation evaluations vill be very difficult to conduct at the 
international level of peace building due to the variety and number of stakeholders and the long 
time spans involved. Hovever, it should be possible t-o conduct evaluations of this type in each of 
the negotiator's countries to reconstruct and promote the beginnings of the social processes that 
lead to the social organizations and relationships associated vith peace building. These 
evaluations vould be sociopolitical processes in keeping vith constructivist inquiry. 2 They vould 
also be local assessments as tlieir outcomes vould depend on local contexts, local infonnants and 



2 "Social, cultural and political aspects, far from being merely distracting or distorting nuisances, are integral to 
the process, at least as important as are considerations of technical adequacy (Cuba & Lincoln, 1 989, p. 263)." 
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Stakeholders, and local values and assumptions. Each of these evaluations vould be undertaken 
separately and vould elicit and take into account political input in the local reconstructions of a 
vide range of stakeholders. These reconstructions should include the social, economic and 
cultural changes that have come from the negotiations, as veil as the political impacts. 

The 'iigDr term consequences of these peace building efforts vill be seen internationally in the 
dewlopment of social organizations like the Nordic Council, the EEC, and Cooperation North in 
Ireland; in social programs like the German Marshall Fund, the Good Neighbors, Sister Cities 
and Partners; and in the proHferation of international meetings and negotiations designed to find 
creative solutions to common problems. Again at the international level, you vill notice that the 
focus of my assessments are on the positive, constructive and collaborative aspects of international 
relations. In keeping vith Serge King's advice a^'the beginning of my talk, these are vhat I seek 
to create and legitimize throu^ my training program and fourth generation evaluations. Of 
course, I am interested in increases or decreases in violent behaviors and events such as crimes, 
accidents and vars, but these are not the focus of my vork. I expect a decrease in the resort to 
violence by individuals and negotiators in international relationships and social structures that 
promote peace building. I choose to siqjport and develop these individuals through training and 
assessment programs that encourage peace building behavior rather than vorking on ehminating 
international behaviors I don't like like coercion and var. 

SUMMARY 

I have suggested that it is important for those interested in contributing to a stable vorld peace to 
focus their attention and vork on positive, proactive programs that vill promote peace building 
rather than negative, reactive programs intended to reduce violence. I have discussed briefly 
such a program of training for international negotiators. I have shovn hov this program vill 
develop self avareness and intercultural communication skills that vill enable these negotiators \o 
better understand and collaborate vith each other in future negotiations. I have proposed a 
constructivist approach for the asessment of these training programs and the subsequent 
negotiations that vill create additional understanding and collaboration among the trainees and 
tliOse vith vhom they negotiate. 

I have also suggested that these informed negotiations vill have an impact of the peace building 
efforts of the negotiators and their constituencies through the development of relationships and 
social structures that promote problem-solving for the mutual benefit and security of all vhen 
situations of conflict arise. I proposed tliat these peace building efforts can be assessed both by 
conventional survey research techniques in the near term and by constructivist inquiry vithin 
countries. International assessment vill be more difficult, but should be possible if the focus of 
the assessments is on development and accomplishments of cooperative international 
organizations, pro,§rams, meetings and negotiations. 
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